Improved Boosting Algorithm Using Combined Weak Classifiers
نویسندگان
چکیده
From family of corrective boosting algorithms (i.e. AdaBoost, LogitBoost) to total corrective algorithms (i.e. LPBoost, TotalBoost, SoftBoost, ERLPBoost), we analysis these methods of sample weight updating. Corrective boosting algorithms update the sample weight according to the last hypothesis; comparatively, total corrective algorithms update the weight with the best one of all weak classifiers. However, all these algorithms just use the local information for updating the sample weight ignoring the global information. In light of this context, we show that updating the sample weight using global information of combined weak classifiers maybe accelerate the convergence speed of boosting algorithm. By simply adding the strong classifier to the linear constraints of LPBoost, a new algorithm was proposed. The experimental results show that our algorithm can achieve both better performance and less generalization error compared to some representative boosting algorithm.
منابع مشابه
A Hybrid Framework for Building an Efficient Incremental Intrusion Detection System
In this paper, a boosting-based incremental hybrid intrusion detection system is introduced. This system combines incremental misuse detection and incremental anomaly detection. We use boosting ensemble of weak classifiers to implement misuse intrusion detection system. It can identify new classes types of intrusions that do not exist in the training dataset for incremental misuse detection. As...
متن کاملLearning Sequential Patterns for Lipreading
This paper presents a machine learning approach to Lip Reading and proposes a novel learning technique called sequential pattern boosting that allows us to efficiently search and combine temporal patterns to form strong spatio-temporal classifiers. Attempts at automatic lip reading need to address the demanding challenge that the problem is inherently temporal in nature. It is crucial to model ...
متن کاملBiometric Face Authentication Using Pixel-Based Weak Classifiers
The performance of face authentication systems has steadily improved over the last few years. State-of-the-art methods use the projection of the gray-scale face image into a Linear Discriminant subspace as input of a classifier such as Support Vector Machines or Multi-layer Perceptrons. Unfortunately, these classifiers involve thousands of parameters that are difficult to store on a smart-card ...
متن کاملBoosting Pixel-based Classifiers for Face Verification
The performance of face verification systems has steadily improved over the last few years. Stateof-the-art methods use the projection of the gray-scale face image into a Linear Discriminant subspace as input of a classifier such as Support Vector Machines or Multi-layer Perceptrons. Unfortunately, these classifiers involve thousands of parameters that are difficult to store on a smart-card for...
متن کاملWriter Demographic Classification Using Bagging and Boosting
Classifying handwriting into a writer demographic category, e.g., gender, age, or handedness of the writer, is useful for more detailed analysis such as writer verification and identification. This paper describes classification into binary demographic categories using document macro features and several different classification methods: a single feed-forward neural network classifier and combi...
متن کامل